SARDSRN: A Neural Network Shift-Reduce Parser
نویسندگان
چکیده
Simple Recurrent Networks (SRNs) have been widely used in natural language tasks. SARDSRN extends the SRN by explicitly representing the input sequence in a SARDNET self-organizing map. The distributed SRN component leads to good generalization and robust cognitive properties, whereas the SARDNET map provides exact representations of the sentence constituents. This combination allows SARDSRN to learn to parse sentences with more complicated structure than can the SRN alone, and suggests that the approach could scale up to realistic natural language.
منابع مشابه
A Memory-Based Alternative for Connectionist Shift-Reduce Parsing
In this paper we present memory-based learning (mbl) as a psychologically plausible model of natural language processing. Mbl shows a state-of-the-art performance on real-world language tasks, such as word pronunciation , word sense disambiguation and parsing. We compare mbl to a neural network model, SardSrn (May-berry & Miikkulainen, 1999) on a parsing task, and we show that mbl has a better ...
متن کاملNeural Shift-Reduce CCG Semantic Parsing
We present a shift-reduce CCG semantic parser. Our parser uses a neural network architecture that balances model capacity and computational cost. We train by transferring a model from a computationally expensive loglinear CKY parser. Our learner addresses two challenges: selecting the best parse for learning when the CKY parser generates multiple correct trees, and learning from partial derivat...
متن کاملEvaluating a Deterministic Shift-Reduce Neural Parser for Constituent Parsing
Greedy transition-based parsers are appealing for their very fast speed, with reasonably high accuracies. In this paper, we build a fast shift-reduce neural constituent parser by using a neural network to make local decisions. One challenge to the parsing speed is the large hidden and output layer sizes caused by the number of constituent labels and branching options. We speed up the parser by ...
متن کاملShift-Reduce CCG Parsing using Neural Network Models
We present a neural network based shiftreduce CCG parser, the first neural-network based parser for CCG. We also study the impact of neural network based tagging models, and greedy versus beam-search parsing, by using a structured neural network model. Our greedy parser obtains a labeled F-score of 83.27%, the best reported result for greedy CCG parsing in the literature (an improvement of 2.5%...
متن کاملExpected F-Measure Training for Shift-Reduce Parsing with Recurrent Neural Networks
We present expected F-measure training for shift-reduce parsing with RNNs, which enables the learning of a global parsing model optimized for sentence-level F1. We apply the model to CCG parsing, where it improves over a strong greedy RNN baseline, by 1.47% F1, yielding state-of-the-art results for shiftreduce CCG parsing.
متن کامل